Optimal integration of auditory and vibrotactile information for judgments of temporal order.

نویسندگان

  • Ian Ley
  • Patrick Haggard
  • Kielan Yarrow
چکیده

Recent research that assessed spatial judgments about multisensory stimuli suggests that humans integrate multisensory inputs in a statistically optimal manner by weighting each input by its normalized reciprocal variance. Is integration similarly optimal when humans judge the temporal properties of bimodal stimuli? Twenty-four participants performed temporal order judgments (TOJs) about 2 spatially separated stimuli. Stimuli were auditory, vibrotactile, or both. The temporal profiles of vibrotactile stimuli were manipulated to produce 3 levels of precision for TOJs. In bimodal conditions, the asynchrony between the 2 unimodal stimuli that comprised a bimodal stimulus was manipulated to determine the weight given to touch. Bimodal performance on 2 measures-judgment uncertainty and tactile weight-was predicted with unimodal data. A model relying exclusively on audition was rejected on the basis of both measures. A second model that selected the best input on each trial did not predict the reduced judgment uncertainty observed in bimodal trials. Only the optimal maximum-likelihood-estimation model predicted both judgment uncertainties and weights; the model's validity is extended to TOJs. Alternatives for modeling the process of event sequencing based on integrated multisensory inputs are discussed.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Tactile--visual temporal ventriloquism: no effect of spatial disparity.

Participants made visual temporal order judgments (TOJs) about which of two lights appeared first while task-irrelevant vibrotactile stimuli delivered to the index finger were presented before the first and after the second light. Temporally misaligned tactile stimuli captured the onsets of the lights, thereby improving sensitivity on the visual TOJ task, indicative of tactile-visual (TV) tempo...

متن کامل

Nothing is irrelevant in a noisy world: sensory illusions reveal obligatory within-and across-modality integration.

In the "flash-beep illusion," a single light flash is perceived as multiple flashes when presented in close temporal proximity to multiple auditory beeps. Accounts of this illusion argue that temporal auditory information interferes with visual information because temporal acuity is better in audition than vision. However, it may also be that whenever there are multiple sensory inputs, the inte...

متن کامل

Effect of visual stimuli on temporal order judgments of a sequence of pure tones

We investigated what effect visual spatial information had on auditory temporal order judgments (TOJs) and examined what effect visual stimuli had on the TOJs of sequences of pure tones in experiment 1. The auditory stimuli were sequences of four distinct pure tones. The visual stimuli consisted of two vertically aligned flashes: one flashed before the first tone and the other flashed after the...

متن کامل

Timing sight and sound

It has been proposed that there is a perceptual compensation for the difference between the speeds of light and sound. We examined this possibility using a range of auditory-visual tasks, in which performance depends on the relative timing of auditory and visual information, and manipulated viewing distance to test for perceptual compensation. We explored auditory-visual integration, cross moda...

متن کامل

Development of Visuo-Auditory Integration in Space and Time

Adults integrate multisensory information optimally (e.g., Ernst and Banks, 2002) while children do not integrate multisensory visual-haptic cues until 8-10 years of age (e.g., Gori et al., 2008). Before that age strong unisensory dominance occurs for size and orientation visual-haptic judgments, possibly reflecting a process of cross-sensory calibration between modalities. It is widely recogni...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Journal of experimental psychology. Human perception and performance

دوره 35 4  شماره 

صفحات  -

تاریخ انتشار 2009